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M.  F.  Janowitz 
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1.  Introduction.  An  order  theoretic  model  for  hierarchical  cluster 
analysis  was  introduced  in  (S |  and  further  deivlO|«cd  in  |c>),  1 7 ) , 
and  (8).  The  Model  was  broad  enough  to  include  earlier  models  due. 
to  Jardinc  and  Sihson  (11)  and  Mitula  (12).  Hie  purpose  of  the 
present  paper  is  to  show  that  the  Model  also  includes  ordinal  non- 
hierarchical  clustering*  and  in  particular  May  he  viewed  as  a  model 
for  ordinal  image  segmentation.  Section  2  contains  some  background 
Material  from  the  thocry  of  partially  ordered  sets,  while  section  3 
relates  this  Material  to  the  problems  of  image  segpentaion.  The 
material  is  approached  via  a  simile  statistical  nodel  in  section  4, 
and  section  5  relates  the  present  model  to  certain  other  segmenta¬ 
tion  techniques.  The  final  section  of  the  paptr  outlines  how  the 
theory  of  section  3  may  be  used  to  construct  a  segmentation  program, 
and  illustrates  the  operation  of  this  program  on  real  data. 
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2.  Background  Material  from  the  theory  of  partially  ordered  sets. 

A  basic  familiarity  with  the  theory  of  partially  ordered  set* 
and  lattices  mil  he  assumed.  Uespitc  this,  it  sill  he  comt-ment 
to  specifically  Jew  lop  certain  notions  here,  Ihlcss  otherwise 
specified,  all  partial  orders  will  be  denoted  ^ ,  with  ^  reserved 
for  set  inclusion.  The  symbol  P|X)  will  represent  the  Boolean 
algebra  formed  by  the  subsets  of  the  set  X,  when  ordered  by  set 
inclusion.  Unions  and  intersections  will  he  represented  as  usual 
by  the  symbols  v  and  «,  and  it  turns  out  to  be  convenient  to  let 
R  denote  the  nonnegative  teal  makers  ordered  in  the  usual  runner. 

Let  P,Q  he  partially  ordered  sets.  A  mapping  «:P  -  c  is 

called  isotone  If  Pj  ?  p,  in  P  iq>lic*  that  «>(pj)  -  c^l  in 

t).  It  is  said  to  he  residuated  in  case  it  is  isotonc  ami  there  is 

an  isotonc  napping  s*:Q  -  P  such  thai  p  <  c*iKp)  and  q  *  4-$  (q) 

hold  for  every  p  *  P,  q  ♦  Q.  This  mapping  s*  is  called  the 

residual  mapping  associated  with  A,  and  is  tmiquely  determined  bv 

6.  Likewise,  *  is  coaplctely  determined  by  »*,  and  for  a  given 

* 

residual  mapping  •?,  it  will  often  be  convenient  to  let  ft  denote 
the  residuated  mopping  with  which  e  is  associated.  Let  Res(P.Q) 
denote  the  set  of  all  residuated  mappings  of  P  into  Q,  writing 
Hes(P)  in  place  of  Res(P,P):  dually,  let  Res*(Q,P)  denote  the 
set  of  all  residual  mappings  of  Q  into  P,  with  Res*(Q)  having 
its  expected  meaning.  The  reason  that  residuated  and  residual 
mappings  crop  up  is  very  simple.  It  was  shown  in  |Sj,  lemma  4.1, 


p.  60  that  a  residual  sapping  C  from  R  into  P(X),  where  X 
is  a  finite  nonempty  set,  may  he  characterized  by  the  following 
three  conditions: 

(1)  C  t>  isotime 

(2)  Hu-rc  is  an  element  h  of  R  that  C(hi  •  v. 

(5)  Given  h  *  R,  there  corresponds  a  positive  teal  nurber 
*>  such  that  C(h)  »  C(h*A). 

If  X  happens  to  he  the  set  of  all  2  element  subsets  of  the  set 
P,  then  this  says  that  C  being  residual  is  equivalent  to  c 
being  a  numerically  stratified  clustering  in  the  sense  of  Jardine 
and  Sibson  [ll|,  p.  bl. 

the  theory*  of  residua  ted  mappings  is  rather  extensively 
developed  in  (3),  and  the  reader  should  refer  to  that  source,  should 
further  information  he  needed. 

3.  The  image  segmentation  problem.  The  underlying  input  data  may 
be  thought  of  as  a  function  F  defined  on  a  hounded  closed 
rectangle  and  taking  values  either  in  R  nr  in  for  some 
positive  integer  p.  The  values  of  1  micht  represent  brightness, 
teiqwraturc,  or  some  other  attribute  of  the  rectangle.  The 
function  F  is  transformed  by  a  sensing  device  into  a  function 
F  having  the  s am  range  as  F,  but  whose  domain  is 
X  *  {1,2,...,*}  *  {1,2, ...,n)  for  suitable  positive  integers  m 
and  n.  The  idea  here  is  to  divide  the  original  rectangle  into 


finitely  anny  subregions  by  aeons  of  a  rectangular  grid,  and  on  each 
such  subregion,  let  F  soaeho*  summarize  the  values  of  (.  Tire 
actual  input  data  that  is  presented  to  the  observer  tlien  i >  not  the 
original  function  F,  but  rather  the  sumaitv  function  f  defined 
on  X;  alternately,  the  input  data  nay  tv  thought  of  as  an  w  in 
n  matrix  taking  values  in  R  or  R**.  Unfortunatelv,  the  puni-ss 
of  going  fro*  F  to  F  has  associated  with  it  soar  noise,  so  F 
represents  a  distorted  view  of  the  actual  data.  The  idea  of  the 
segmentation  process  is  to  recapture  the  principal  regions 
represented  by  F.  A  acre  precise  and  detailed  description  of  the 
assertions  relating  to  this  are  contained  in  |9J  and  |1<M.  lor 
that  reason  they  will  not  be  repeated  here.  Me  should  ncntion 
though  that  our  attention  will  be  restricted  to  the  case  where  I 
takes  values  in  R,  with  the  oiltifeatuie  situation  to  be  investi¬ 
gated  in  a  later  paper. 

Let  us  see  how  to  embed  the  segmentation  problem  into  the  node! 
for  hierarchical  clustering  that  was  presented  in  |S|.  Think  of  (he 
input  data  either  as  a  mopping  D:X  «  R,  where  X  *  U,2,...,w  • 
(l,2,...,n),  or  as  an  m  by  n  matrix  A  with  entries  from  R. 
The  idea  is  to  somehow  represent  the  information  provided  by  A  as 
a  matrix  B  (possibly  of  a  site  smaller  than  A)  that  has  fewer 
distinct  levels  of  entries.  1b  properly  place  this  problem  in  an 
order  theoretic  setting,  recall  ((S),  p.  61)  that  D  extends 
natural lv  to  a  residuated  mapping  P*:P(X)  -*  R  by  letting 


* 


D*(M)  •*{0(n):n«  M*  for  all  subsets  M  of  X.  1  f  D*  denote- 
the  unique  residual  napping  associated  with  1*,  we  have  estatdUlted 
a  Injection  between  napping*  fro*  X  into  R  and  residual  nupyuigs 
from  R  into  *VX).  Thus  the  inage  scparctation  problem  wav  h«.- 
newed  as  the  study  of  transfo mat  ions  of  V**  k,  f\  v  * )  into 
Res*(R,  PiY))  where  V  £  V.  1  ran*  fo  nations  Such  a;  tins  will  K* 
called  segmentation  nethods.  Hus  (daces  the  vgpwmat ion  problem 
squarely  within  the  fraaewori  of  the  aodel  described  in  1S|. 

lor  input  data  having  only  ordinal  significance,  we  would 
like  to  describe  the  class  of  segmentation  nethods  that  should 
properly  he  used.  *n  order  to  do  this,  we  need  the  notion  of 
coi^Mtihility  (|S|,  p.  MS).  Let  I  he  a  scpvntation  net  hod  and 
I  9  a  residual  napping  on  R.  Tb  say  that  F  is  (‘-compatible  is  to 

say  that  for  even*  C  «•  Re»#(R,p{X)),  FJC  *  «)  *  F(C)  •  lor 
data  having  onlv  ordinal  significance,  one  should  insist  on 
I  -angst ihili tv  for  all  order  automorphisms  of  R  and  this  loads 

to  a  class  of  segmentation  techniques  that  are  called  monotone 
cqui  variant.  These  are  characterised  (|?|,  Theorem  1,  p.  149)  as 
follows:  Let  C  »  Res’iR.i’fXjf) .  Tb  say  that  h  (h  *  R»  is  a 
splitting  level  of  C  is  to  say  that  h  is  the  image  of  some 

ft 

subset  of  X  under  the  res idea  tod  tapping  C  associated  with  (  . 

If  0  <  hj  <...<ht  denote  the  splitting  levels  of  C,  then  to  say 
that  the  segmentation  method  F  is  manotone  equi variant  is  to  say 


that: 


(U  even-  splitting  level  of  F(C)  is  a  splitting  level  ,.i  i. 

lii)  the  sequence  FC(O)  -  FCfhj)  s...‘-lt(ht)  dei*nds  onl> 
upon  the  sequence  C(0)  <  C(hj)«...<C(ht)  and  is 
independent  of  the  actual  values  of  the  h.'s. 

(iii)  conditions  li)  and  (ii)  hold  for  c't-n;  C  !tes*l«,*‘(  vj  j . 

One  can  associate  with  each  stiisct  T  of  Ro*(R)  the  collection 
a(T)  of  all  segmentation  Methods  that  are  fcoqpattblc  for  even 
•>  *  T;  conversely,  for  any  set  S  of  segMntation  Methods,  one  can 
associate  the  set  a(S)  of  all  v  <  Res(R)  such  that  F  t> 
^compatible  for  every  F  in  S.  Naturally,  for  tais  to  be  mean¬ 
ingful,  one  mat  think  of  a  sepaentat  ion  method  as  a  mapping 
F:  Res*(R,P(X))  -  Res*(R,P(Y>)  shore  Y  is  a  fixed  sUbsct  of 
In  any  event,  the  mappings  (■<*,«)  define  a  gaiois  correspondence 
in  the  sense  of  (2|,  p.  124  between  the  residual  mappings  on  R  and 
the  sejpwntation  methods  on  X.  It  generally  turns  out  that  the 
gaiois  closed  objects  (i.e.,  those  objects  that  appear  as  images 
of  n  or  fc)  of  such  correspondences  have  some  significance,  hi 
have  already  seen  that  the  monotone  equi  variant  cluster  methods 
appear  as  the  image  under  a  of  the  set  of  order  automorphisms  of 
R,  so  they  arc  gaiois  closed.  F.  Baulieu  (1)  has  among  many  other 
things  characterized  all  closed  classes  that  are  contained  in  this 
one.  Here  is  a  description  of  these  classes: 

(51)  Flat  methods.  RC(h)  depends  only  upon  C(h). 

(52)  Semiflat  methods.  FC(h)  depends  upon  C(h)  and  C(0). 


(53)  Divisive  Methods.  Rllh^)  depends  upon 
t‘(hi^j),...,l‘(ht)  where  ht  is  the  highest  splitting 
level  of  C. 

(54)  Sf(|>  Methods.  K(0)  depends  on! >  iron  i.'(U);  for 

h  •  0,  ri(hj)  detrends  on  C(h-<,  . uJ^). 

(55)  Mono  tone  mrnvari  ant  met  hods . 

The  related  sets  of  residual  Mappings,  ill  I  corresponding  to 

IS*) .  ore: 

1TI )  Res(R) 

(T2)  Die  set  of  all  residual  Mappings  «  on  R  for  which 
slO)  *  0. 

(T3)  Those  residual  MBps  whose  range  is  of  the  form  *h:h  k 
for  somc  fixed  elcMent  k  of  R;  i.e.,  whose  range  is  a 
principal  filter  of  R. 

(T4)  Those  residual  Maps  whose  range  is  the  union  of  (tH 
with  a  principal  filter  of  R. 

(TS)  The  set  of  all  injective  residual  Mappings  on  R. 

The  siaplcst  of  the  closed  classes  of  segMtntation  Methods  is  of 
course  the  flat  •acthods,  and  it  is  to  this  class  that  vc  now  direct 
our  attention.  Seedless  to  *av,  such  Methods  arc  easv  to  describe 
and  easy  to  ixjdcMcnt.  Mr  are  given  a  fixed  finite  nonc«rtv  *ct  x 


and  an  increasing  sequence 

Mj  r  H,  ' ...  •  x 


i 


8 


( 


s 


of  subsets  of  \,  where  Nf  «  C(h^),  and  wish  to  produce  a  sequence 
£.  .  t  \  «  X 

of  subsets  of  X  that  soochow  suanri:r  or  better  represent  the 
underlying  picture  than  does  the  input  dat:-  *>*  the  prohletB.  Jm  that 
depends  only  i|>on  N- ,  this  unmints  to  defining  an  isotone 
napping  '  00  f'(X). 

Having  recognized  the  need  to  define  an  isotone  waging  an 

.fX),  it  is  appropriate  to  decide  upon  reasonable  candidates  for 

these  Mappings.  Hie  idea  is  to  attach  none  spatial  significant e  to 

the  decision  as  to  whether  a  given  point  belong-  to  the  output  of 

the  napping.  In  other  words,  the  decision  as  to  whether  *  belong* 

to  nM)  should  he  based  upon  ail  points  in  some  snail  region 

surrounding  x.  rhls  nv  he  prcciselv  stated  hv  -aying  that  the 

wpping  *  shall  he  ;o  I  n  t  •  Hosed  In  that  for  each  x  -  «<\l  there 

is  a  subset  N(x)  of  X  containing  x  such  that: 

(PHI)  * ( 3 )  *  *  and  >(N(x))  *  3. 

(PB2)  lor  X:\fxl,  if  then  x  <(A). 

(1X83)  lor  X  x  «  ■  (M)  if  and  onl'  if  *  »  i(Mr\(»)l . 

It  is  iamediate  that  for  X  --  >  (X)  *  t(X  Mxt).  V*  that 

x* *(\) 

the  output  will  he  independent  of  the  jolaritv  of  the  input  imagi, 
it  sonet  ines  turns  out  to  he  useful  to  insist  that  <  preserve 
cosylcwents  in  that 

fFW)  For  M  c  x,  « (X\M)  *  >  (X)  (X) . 


The  local  version  of  (PM)  is  the  content  of  Theorem  1 . 

Theorem  1.  for  a  point -based  isotone  napping  , on  /».*), 

axiom  { PM )  is  emu  valent  lo  the  assertion  tlut  for  each  sublet 
A  of  X(x) ,  exactly  one  of  t(A)  and  > (Mx)  A'  u j  1 1  be  roir^iy. 

Proof:  let  r  satisfy  (PB4).  If  x<  »(A)< .<\(x)  A) ,  then 
x  «.  ♦  (A)  n  *(X  A),  contrary  to  (PM),  for  the  converse  implication, 
assuac  that  ■»  is  point -based  and  that  for  a  ^  Mx) ,  exactly  one 
of  i  (A)  and  « (X(x)\A)  is  noncafity.  If  not,  v  .  r(\'\M),  then 
y-  >((V;0>(X{v))t  SO  y  #  y(HkN(v)),  and  consequently,  y  f  ,(M). 
Owivcrsely,  >  /  *(M)*  y  /  yQhX(y)),  »  y  <  *  ( XM) . 

•'to*  let  t  be  point -based  with  an  associated  family  of  ncightor- 
hoods  N(x),  x  t(JQ.  If  H(x)  is  a  second  such  family  of 

neighborhoods,  it  is  clear  that  so  also  is  Mix)  «  Wx).  !n  vie**  of 
this,  there  is  no  harm  in  assuming 

(PBS)  If  M(x)  satisfies  (FBI )  through  (PBJ),  then 
N(*)  *  M(x) . 

Such  a  minimal  family  of  subsets  of  X  mill  he  called  the  system  of 
neighborhoods  associated  with  t.  Unless  otherwise  specified,  when 
we  speak  of  a  point-based  isotone  mapping  y,  it  will  always  hr 
assumed  that  the  family  fN(x):x  «  r(X)>  represents  this  system  of 
neighborhoods. 


10 


Oefinit  ion.  The  point-based  iso  tone  napping  .  is  said  tu  he 
f  reguencv  -  defined  if  there  exist  positive  integers  i  and  k  >uch 
that  for  each  x  «  <('J. 

(i)  *\i*>  -  k,  and 

(u)  x  ,tM)  for  M  i.  X  if  and  on! >  if  \  *(M\<x)). 

Here  *\  denotes  the  cardinality  of  the  set  A. 

Theorco  ».  Let  »  be  a  pomt-hased,  cocy!  caent  -prtstrv  iii^ 
isotonc  wfpifig  on  P( \) .  Suppose  that  the  regions  \(x?  all  law 
the  Mir  cardinality,  amt  that  for  each  x  .  ,  ( vi .  has  numn:! 


cardinality  amine  those  -ufrsct s  \  of  Mx)  for  uhich  »■  -(A). 

Necessary  and  sufficient  conditions  for  *  to  ]*■’  ha.-oJ 

arc  that  k  *  *.V(x)  be  odd,  and  that  *\%  *  (l*k)/2  for  all 
a  -  i(\). 


Proof:  let  r  be  frequency 'based.  If  k/2 ,  tben 

1  k/2,  and  there  is  a  subset  B  of  S(%)  -utb  that 

*8  »  M.  Since  »IB1  *  «,  this  produces  a  contradiction.  Jf  k 
is  even,  taking  8  _  *1  nith  cardinality  k/2  produce-  a  -11111131 

contradiction.  Thus  k  is  odd  and  k/2.  If  *\%  ll*k)/2, 

we  nv  take  S  c  so  that  *B  *  (I»k)/2.  since  *(V(x)  PI  ' 
this  tells  us  that  r(B)  *  a  *  »(N(x)B),  contrary  to  (PH4).  Thus 
•A^  «ust  espial  (l»k)/2.  Suppose  conversely  that  k  *  *N(xl  is 
odd  and  that  t\%  is  necessarily  fl*k)/2.  Me  arc  to  -hcs.  that 


is  frequency- based.  By  construction  of  A^.,  x  y t B)  for 
B  ‘  \(x)  unifies  that  »B  -  *Ax  =  (l+kJ/2.  If  on  the  other  hind, 

■B  (1  ♦10/2,  then  (l*k)/2,  so  Y(N(x)  .B)  -  and 

consequently,  x  •  'i(B). 

One  is  often  interested  in  the  extent  which  a  segmentation 
algorithm  blurs  an  image.  Hie  merging  of  clusters  that  slwuld  not 
be  merged  is  one  of  the  ways  in  which  such  blurring  occurs.  1o 
illustrate  this  concretely,  let  us  consider  a  frequency- defined 
mapping  •  tiiat  operates  on  5  by  3  neighborhoods  centered  on  joints, 
bupiosc  \  ius  5  rows  and  5  col  tin  ns,  and  that  M.N  are  tiic  regions 
denoted  by  I'  >,  2' s  m  fig.  2(a).  In  lig.  2  (h),  the  members  of 
*  (M) ,  *  ( N)  arc  denoted  by  l's,  2*s,  while  in  fig.  2(c),  the 
members  of  > (M  \)  arc  indicated  by  3’s.  .VI 1  remaining  entries 
are  i>.  >otice  that  .(MuS)  >  v(M)  <•  y ( N J .  In  connection  wit), 
this,  we  shall  say 
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*  »  *  “I  ** 

i  n  i  1  1 

(a) 


0  0  0  0  0 
n  1  1  1  0 
o  0  r  0  0 
0  2  2  2  0 
0  0  0  0  0 
(h) 


0  0  0  0  0 
0  3  3  3  0 
0  3  3  3  0 
0  3  3  3  0 
0  0  0  0  0 
(C) 


fig.  2  Illustration  of  blurring-  Sec  text  for  cxplantation. 


that  M,N  arc  t-separated  for  the  isotone  point-based  mapping  t 
in  case  there  is  rw  set  of  the  form  N(x)  that  intersects  both  M 


Proof:  IVidentlv,  we  need  only  show  that  >(M<M  ■  *(M]  >(M. 

Accordingly,  let  x  *  . (MjK),  so  (Mbs')  Mx'  '  C  -  Since  V, \  arc 
y-separated,  we  aust  have  (MuNVMx)  «  Mr»S(\i  i*r  M>S(xi,  whence 
x  .  v(M)  u  v(,V). 

Along  these  lines,  the  sapping  *  will  he  called  a  join 
homoaorphisw  incase  t(MuX)  •  y(M|  j  » ( K)  for  all  subsets  M.s 
of  X.  There  is  a  dual  notion  of  sect  hoaoaorphtsiB,  anJ  to  saw  that 
>  is  a  houoworphisai  is  to  say  that  it  is  hoth  .1  win  aid  a  went 
honoaorphiSK.  The  next  thooroa  shows  that  these  count  ion'  are 
ex traacly  powerful,  aid  will  only  be  act  in  trivial  situation-. 

Thooroa  4.  Let  y  he  a  ixiint-hascd  iso  tone  wnung  on  r<  \ . 
lien  (la)«“>(lb),  (2a)<**(2b)  and  (&)*•  »(Xh) . 

(la)  y  is  a  join  hoaworphisw. 

(lh)  For  each  x  •  y(X)  there  is  a  subset  \%  of  N(x)  such  that 
x  «■  >(M)  if  any  only  if 
(2a)  1  is  a  aect  howoworphisai. 

(2b)  Corresjonding  to  each  x  •  >(\),  there  is  a  subset  of 
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(3b)  tor  each  x  *  r(X)  there  corresponds  an  elunont  >x  °~{  MxJ 
such  that  x  i  i(M)  if  and  only  if  v  «.  M. 

Proof:  (la)  ">(lb).  If  >  is  a  join  homotnoridwsm,  let  C  be  the 
union  of  all  subsets  of  S(x)  that  arc  to  ;  b>  >,  jrd 

note  that  »(C)  »  e.  Observing  that  i(H  N(x))  *  }  if  and  only  if 
M«X(x)  ■_  C,  we  apv  now  take  >\%  »  N(x)vt‘. 

(lb)  -•‘(la)  If  x  *  y(MjK),  then  (MuNV«Ax  *  i>,  so  M  Ax 
or  X  v\  *  o.  Hence  x  *  > CM)  u  y(N). 

(2a)  «»>(2b)  If  Bx  is  the  intersection  of  all  subsets  C 
of  N(x)  for  which  (VT)  *  $,  then  \  «  even-  . 'O,  x  (1M. 

(2b)  is  now  clear. 

(2b)  —  >(28)  is  obvious,  as  is  (3b)  -»>(3a). 

(3o)  —>(3b)  If  B_  is  defined  as  in  (2),  then  y(B  )  *■  i, 
but  >((.)  *  $  for  every  proper  subset  C  of  Bx-  It  is  immediate 
that  B  •  (v  ),  and  (3b)  row  follows. 

Remark  S.  feting  that  if  y  in  the  theorem  is  compl<sncnt- 
preserving,  then  it  is  a  join  homomorphism  if  and  only  if  it  is  a 
meet  homomorphism,  it  follows  that  for  such  mappings  the  six 
conditions  of  the  theorem  arc  mutually  equivalent. 

If  M  c_X  is  acted  upon  by  a  rigid  notion  to  produce  N,  one 
would  naturally  want  that  same  rigid  motion  acting  upon  >(M)  to 
produce  y(X).  A  careful  formulation  of  this  idea  shows  that  this 


i 


is  too  much  to  hope  for.  To  see  why,  wc  need  the  concept  of  a 
translation  on  X:  this  is  a  manninc  of  the  lorn  T  where  n.u 

-  iif.  p.q  * 

are  fixed  integers  and  I  (i.i)  *  tl»p. i»q].  Unless  p  a  =  M, 

r  »M 

the  domain  and  ratine  of  T  will  Ik*  proper  subsets  oi  X.  Jie 

PtM 

a^rce  to  call  the  point-based  isotone  napping  translat ion- invariant 
provided  it  satisfies: 

(PB6)  If  N(x)  is  contained  in  the  domain  of  the  translation  T, 
ami  if  y  ■  T(x),  then  N(y)  *  T(\(x)),  and  for  A  <-  \'(x), 
x  •  > f A)  if  and  only  if  v  <  , (1(A)). 

Remark  ft.  If  y  is  a  point-based,  translat ion- invariant 
iso  tone  mapping  on  P(\),  and  if  M  ^domain  11)  with 
M  ■  T|M)  •  y (X) ,  it  is  true  that  Tf  .  (M))  »  y (T (M) ) .  This  may  fail, 
however,  if  either  M  or  T(M)  is  not  contained  in  >  ( \ ) .  This  is 
illustrated  in  Tig.  3.  Here  X  *  S  *  S,  where  S  ■  (1,2,3,4,51. 

The  mapping  y  is  defined  by  looking  at  3  by  3  neighborhoods 
centered  on  the  points  of  X,  and  saying  that  for  A  \(x),  x  t  y(A) 
iff  *A  >  5.  This  choice  of  y  satisfies  (PBl)  through  (PBft), 
and  is  even  frequency -defined,  Let  x  •  (2,2)  and  T  =  Tj  j ,  so 
that  T(x)  *  (3,3).  Then  Tig.  3(a)  shows  Six),  Tig.  3(b)  shows 
T(N(xl)  »N(T(x)),  while  y(N(x))  and  >(T(N(x)))  arc  displayed 
in  (c)  and  (d).  The  reason  that  T(y(N(x)))  f  y(T(N(x))J  is  tfiat 
T(N(x))  is  contained  in  y(X),  while  N(x)  is  not. 
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1110  0 
1110  1) 
1  l  1  0  0 
0  0  0  0  0 
0  0  0  0  0 
(a)  M  «  N(x) 


0  0  0  0  0 
0  1110 
0  1110 
0  1  1  l  0 
0  0  0  0  0 
(b)  T(M) 


0  0  0  0  0 
0  110  0 
0  10  0  0 
0  0  0  0  0 
0  0  0  0  0 
(C)  Y (M) 


0  0  0  0  0 
0  0  1  0  0 
0  1110 
r  .  i  0  o 

0  0  0  I)  0 

(cl)  »Ci(M)) 


Fig.  5  Sec  text  for  explanation. 


Remark  7.  Hor  translation*  invariant  mappings  y  on  P(.V), 
the  conditions  expressed  in  Theorems  2,5  ant*  4  can  he  simpl  if  i'*\  as 
one  need  only  state  them  for  a  single  memher  of  .  (X>.  The  details 
of  this  are  left  to  the  reader.  Kc  also  mention  without  proof 
that  versions  of  the  above  results  are  true  for  atomistic 
orthomodular  latticcs(|2j,  p.  S3). 


Ronark  8.  The  actual  construction  of  a  point-based  isotone 
mapping  on  P(X)  can  now  be  easily  understood.  One  chooses  a 
system  of  neighborhoods  N(x)  for  points  x  in  some  subset  V  of 
X,  and  defines  a  family  (v  )  v,  where  y  is  an  isotone  mapping 
on  N(x)  such  that  : 

(1)  Yx(<)  «  and  yx(N(x))  *  (x) . 

If  one  wants  to  produce  a  complement- preserving  mapping,  tlien  one 
also  wants 

(2)  If  A  r  N(x),  then  exactly  one  of  >X(A)  and  r^lMxl  A) 
is  non-empty. 


The  mapping  »  is  now  defined  by  the  rule  x  <  y(M)  if  and  onl>  i 
>x(M»N(x))  ■  (xj.  This  is  the  technique  that  will  be  used  for  the 
remainder  of  the  pnf>cr. 

Remark  9.  Though  it  might  not  necessarily  make  sense  to  use 
point- based  mappings  that  >'ire  not  frequency -defined,  it  is  easy  to 
construct  examples  of  them.  Tb  see  this,  let  N(x)  be  a  3  by  3 
region  centered  on  x.  For  A  c  N(x),  let  vx(A)  ■  lx)  if  at 
least  2  out  of  the  3  rows  of  N(x)  each  has  at  least  2  manber;  A 
A;  otherwise,  let  YX(A)  -  Do  this  for  each  x  that  is  not  in 
an  outer  row  or  colimn  of  X,  and  use  the  construction  of  Remark  8 
to  define  a  mapping  y  on  P(X) .  lie  result  is  a  point-based, 
complement- preserving  iso  tone  mapping  that  is  rot  f  requcncy  -  def  i  nod 
Clearly  this  example  is  representative  of  an  entire  class  or  such 
mappings.  Other  candidates  for  y  are  pattern- defined  mappings. 
These  put  x  in  yx(A)  if  A  contains  a  subset  of  a  desired  type 
For  3  by  3  neighborhoods,  such  desired  types  might  include  sets 
such  as 

111  110 

0  10  or  110 

0  0  0  0  0  0. 

4.  Underlying  statistical  considerations.  We  have  just  seen  that 
the  construction  of  a  flat  segmentation  method  involves  the 
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definition  of  an  isotone  napping  on  P(X).  If  the  injxit  data  were 
correct,  then  tiie  most  reasonable  choice  for  such  a  mapping  might  be 
the  identity  nap  or  a  map  of  die  form  ?!  -*  M  V  for  some  subset  > 
of  X.  The  idea  though  is  to  use  the  isotono  nipping  *  to  produce 
an  estimate  of  the  true  data  that  is  in  some  sense  Ivttcr  than  the 
one  provided  by  tiie  input  data.  Specifically,  let  us  assume  that 
the  data  represents  a  subset  M*  of  X,  but  that  the  input  data 
produced  M  instead.  One  wants  to  estimate  M*  by  ,  (M).  As  in  the 
last  section,  it  is  asstned  that  X  ■  {l,2,...,m}  «  {l,Z,...,n*.  Let 
(N(x) )  be  a  system  of  neighborhoods  of  points  x  in  some  subset  V 
of  X.  To  say  that  a  point  (i,j)  is  an  interior  point  of  the  set 
M*  will  be  to  say  that  for  x  »  (i,j),  N(x)  £  M*;  a  similar 
definition  applies  to  the  complement  of  M*.  If  \’(x)  intersects 
both  M*  and  its  complement,  then  x  will  be  called  a  boundary 
point  of  'I*.  Thus  X  is  divided  into  4  regions:  (1)  the  interior 
of  M*,  (21  the  interior  of  X\M*,  (3)  the  boundary  of  M*,  and 
(4)  those  points  which  do  not  have  neighborhoods  (i.e.,  X\Y).  This 
is  concretely  illustrated  in  Fig.  4.  Here  we  take  m  *  10,  n  =  7, 
and  N(x)  a  3  by  3  region  centered  on  x.  \  would  then  consist  of 
all  points  not  in  an  outer  row  or  colunn  of  X.  The  members  of  V!* 
are  denoted  by  l*s  in  Fig.  4(a)  with  those  of  X\M*  represented  by 
0's.  The  resulting  4  regions  are  displayed  in  Fig.  4(b)  and  are 
nunbered  as  above. 
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0  0  0  0  0  0  0 

0  0  0  0  0  1  1 

0  0  0  0  1  1  1 

0  0  0  1  1  1  1 

0  0  1  1  1  l  1 

0  0  11111 

0  0  11111 

0  0  0  l  0  1  1 

0  0  0  0  1  1  1 

0  0  0  0  0  1  1 

(a)  Original  picture 


4  4  4  4  4  4  4 

4  2  2  3  5  5  4 

4  2  3  3  5  1  4 

4  3  3  3  3  1  4 

4  3  3  5  1  1  4 

4  3  5  1  1  1  4 

4  3  3  3  3  3  4 

4  5  3  3  5  3  . 

4  2  3  3  3  5  4 

4  4  4  4  4  4  4 

(b)  3  by  3  nei^hltorhoods 


Fig.  4.  See  text  for  explanation. 


A  crude  model  may  be  constructed  by  assuming  that  membership  in 
M  has  probability  p  (p  >  0.S)  of  providing  a  correct  estimate  of 
membership  in  M*,  and  that  membership  in  X\M  has  a  probability 
qiq  >  0.5)  of  providing  a  correct  estimate  for  membership  in  M.  Let 
us  also  ass» me  that  these  prohabil  itics  arc  each  inilq>erwlcnt ,  bearing 
in  nind  that  in  practice  this  is  sometimes  not  so.  Realistically, 
one  should  also  notice  that  boundary  points  will  have  a  lower 
probability  of  correct  classification  than  do  interior  points,  but 
this  is  an  issue  that  will  be  tenporarily  ignored.  The  gain  of  an 
isotone  mapping  y  is  defined  to  be  the  sun  of  the  probability  of 
correct  classification  by  y  for  an  interior  point  of  M*  and  an 
interior  point  of  X\M*,  and  is  denoted  G(y).  Until  further  notice, 
it  will  be  nssuned  that  y  is  a  point-based,  translation- invariant 
isotone  mapping  on  P(X).  It  will  prove  convenient  for  a  fixed  N(x) 
to  let  *  {A:  A  £  N(x) ,  x  e  y(A)}  and  =  {A:  A  i_  N(x),  y(A)  *  4). 
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Letting  A1  denote  a  typical  subset  of  N(x)  having  cardinality  j, 
we  have  then  have 

G(> )  -  Kp1(l-p)k’I:AI  -  T  >  *  r'd^O^'^A*  .  I  ). 
where  k  ■  *N(x).  In  order  to  see  the  role  of  frequency -defined 
mappings  in  this  model,  we  present 

Lemma  10.  Let  y  be  complement -preserving  with  k  ■  *\(x)  odd, 
and  let  y*  be  the  frequency-defined,  point -based  isotone  mapping 
having  the  sane  neighborhood  system  as  y.  Then  C(>)  <  G(y’)* 

k-  1 

Proof:  Since  y  is  convenient -preserving,  *T  ■  *F^  »  2 
The  same  is  true  for  y'.  Tims  a  bisection  $  may  be  defined  on 
P(N(x))  such  that  0  maps  onto  Ty,  and  F^  onto  Fyl.  We 
may  even  take  $  to  be  the  identity  map  on  (T^nT^,)  u  (F^ni^,). 

For  Ac  T  ftF  , ,  *A  <  j  -  (  l*k)/2,  while  *$>(A)  ?  j,  so 
*A  <  *o (A) .  A  similar  argument  shows  that  for  A  »  F^  oT^,, 

»A  >  *0 (A) .  Using  <p  to  match  the  terms  of  G(y)  with  those  of 
with  those  of  G(y’)»  it  is  clear  that  each  term  of  G(y)  is  no 
larger  than  the  corresponding  term  of  G(y')»  so  G(y)  <  G(y’). 

Theorem  11.  If  p  ■  q,  and  if  y  and  y ’  have  the  same  system 
N(x)  of  neighborhoods  with  y'  frequency -defined,  then  G(y)  •  G(v') 
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Proof:  In  view  of  Leona  10,  we  need  only  produce  a  complement- 
preserving  point-based  isotone  mapping  v"  with  \‘(x)  as  neighbor 

hoods  such  that  C(y)  *-  G(y").  This  will  be  accompl ished  bv  making 
use  of  Remark  8.  Choose  some  fixed  N ( x ) ,  and  consider  subsets  A 
of  N(x).  If  x  <  t (A)  y(N(x)\A)  with  r.\  j,  take  »"(A)  *  <.v* 

and  y"(N(x)w\)  ■  <$.  If  y(A)  -  $  ■  r(X(x)\A)  with  *A  •  j,  do  the 
same.  Otherwise,  let  /"(A)  ■  {x*  if  x  •  r(A)  and  y"(A)  *  i  if 

y(A)  ■  <i.  Wc  need  to  show  that  ym  is  isotone.  Tlic  proof  will  be 
by  contradiction.  Suppose  then  that  A  «  B  i_  N(x)  with  »"(A)  .«  v"(B). 
Then  y'*(A)  ■  (x)  and  y"(B)  ■  $.  By  the  construction  of  y",  wo 
must  either  have  x  .  y(A)  or  *A  :>  j. 

Case  1.  x  *  y (A) .  Then  also  x  «  y(B),  so  if  y"(B)  *  then 

x  •  y(B)  n  y(N*,x)\B)  and  *B  <  j.  Since  A  «■  B  implies 
X(x)\A  3  N'(x)  B,  this  puts  x  in  y(S(x)\A),  whence  y"(A)  ■  9>» 
a  contradiction. 

Case  2.  #A  >  j.  Then  also  *B  s  j.  The  only  way  for  y"(B)  = 

is  for  y(B)  *  <>,  so  y(A)  *  i  and  consequently  y"(A)  ■  $,  again 

a  contradiction. 

This  then  establishes  that  y"  is  isotonc.  The  construction  of 
Remark  8  can  now  he  used  to  extend  y" to  a  point ’based,  complement- 
preserving  isotone  mapping  on  P(X)  having  the  same  neighborhood 
system  as  y.  We  must  still  show  that  G(y)  <  G(Y')*  The  changes 
in  these  sums  occur  from  members  of  (T^nF^,,)  u  (Ty„rF^).  If 
A1  c  T.^nF^,,,  then  i  <  j,  and  the  term  corresponding  to  A1  in 
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C(y)  is  p  (1 -p)  ,  while  the  corresponding  term  in  G(i")  is 

k*  i  i 

p  (l-p)  .  In  that  i  -■  k-i  and  p  >  0.5,  this  represents  an 
increase.  Similarly,  if  A1  .  T^„n^ ,  then  i  -  i ,  and  again 
the  term  from  G(>")  •  the  corresponding  term  from  G(i). 

When  p  ■  q,  the  above  theorem  shows  that  the  ’'gain"  from  a 
flat  segmentation  method  can  he  maximized  bv  using  a  point -based 
isotonc  mapping  that  is  comp lenient -preserving  and  frequency -defined. 
This  amounts  to  saying  that  such  mappings  maximize  the  probability 
of  correct  classification  of  interior  points,  as  this  probability 
is  just  half  the  gain.  With  this  thought  in  mind,  we  shall  direct 
our  attention  to  mappings  of  the  above  type  defined  on  k  by  k 
neighborhoods  of  points  with  k  an  odd  integer.  The  j/k2  rule 
with  j  •  (l*k*)/2  will  be  the  unique  such  mapping  on  a  k  by  k 
neighborhood,  and  the  3/5  rule  will  refer  to  the  unique  t  defined 
on  the  region  consisting  of  x  and  the  4  points  that  are  immediately 
to  its  North,  South,  lost  and  West.  These  rules  were  introduced  in 
a  slightly  different  context  in  (9),  and  some  discussion  given  to  the 
probability  of  correct  classification  of  points  in  the  case  of  interior 
points  as  well  as  boundary  points.  These  probabilities  are  all  based 
on  an  underlying  binomial  distribution  of  N(x) ,  and  will  not  be 
repeated  here. 

There  is  another  item  worth  mentioning,  however.  To  improve 
the  classification  of  interior  points,  one  singly  enlarges  the  size 
of  the  k  by  k  region.  This  is  fine  except  that  as  k  increases 


the  nuflber  of  boundary  points  also  increases,  and  as  was  sltown  m 
(9),  the  probability'  of  misclassification  of  boundary  points  can 
actually  increase  when  the  y/k’  rule  is  used.  11ns  i*  illustrated 
by  some  simulations  in  Table  1.  The  segmentations  are  Jonc  on  the 
data  of  Fig.  6(b)  corrupted  by  various  tyj  es  of  additive  nojse  u j th 
the  indicated  signal  to  noise  ratio.  The  theoretical  prohahil  ity  of 
misc lass ificat ion  of  interior  points  is  compared  to  the  actual 
probability  hased  on  10  trials,  and  this  is  compared  to  the 
probability  of  nisclassification  in  the  entire  picture.  Note  hm» 
the  ratio  of  the  probability  for  misclassification  of  interior 
points  over  that  of  the  entire  picture  changes  as  the  value  of  k 
increases  from  5  to  9  to  25. 

All  of  this  suggests  that  there  may  be  occasions  when  one  wants 

y 

to  use  flat  segmentation  method  other  than  that  provided  ly  t ho  i/k" 
rule.  For  3  by  3  regions,  one  idea  might  be  to  define  >  on  Six' 
follows:  >  (A)  ■  ix}  if  *A  >6  or  if  *-\  ■  4  or  5  and  x  .  \. 
Naturally  this  will  increase  the  probability  of  misclassification  of 
interior  points,  but  may  do  a  slightly  better  .iob  near  the  boundary 
of  a  region.  This  is  illustrated  in  Table  2,  where  this  rule  is 
centered  to  the  5/9  rule  for  regions  containing  various  mixtures  of 
members  of  M  and  its  complement.  Notice  the  rather  dramatic 
increase  on  probability  of  correct  classification  near  the  boundary 
as  evidenced  by  the  box  relating  to  *M  *  5.  A  conparison  of  the 
two  methods  on  real  data  is  displayed  in  Fig.  S. 
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Table  1.  Simulated  data  based  on  10  trials.  Entries  in  the  table 
represent  probabilities  of  misclassification.  The  coliamr 
labelled  SD  refer  to  the  standard  deviation  of  this 
probability,  and  the  "Ratio"  column  is  sisqily  the  observed 
probability  for  interior  points  divided  by  the  observed 
probability  for  the  entire  picture.  The  columns  headed 
"Actual  Image”  refer  to  Fig.  6  with  additive  gauss ian 
noise  having  the  indicated  signal  to  noise  ratio.  The 
remaining  colimns  apply  to  the  identical  noise  on  the 
interior  of  a  single  region.  The  signal  to  noise  ratio 
is  the  difference  in  grey  levels  that  characterize  the 
input  set  from  its  background  divided  by  the  standard 
deviation  of  the  noise. 


« 


Tabic  2.  M  is  a  sirf>sct  of  a  3  by  3  rectangle  with  the  indicated 
cardinality.  The  Prob.  Correct  refer*  to  the  probability 
that  the  actual  input  data  provides  a  comet  estimate  of 
wewhorship  in  M.  The  entries  in  the  column*  labelled 
*‘Mran”  refers  to  the  wean  percentage  of  probability  of 
correct  classification  based  on  20  trial*,  and  the  "Mr* 
coliaans  refer  to  the  standard  deviations  of  these  mean*. 
See  text  for  an  explanation  of  the  meJi fieri  V’  rule. 


Another  approach  to  modifying  a  frequency -based  mapping  is  to 

use  some  sort  ol  pattern-based  mapping.  A  way  of  implement  j  ng  this 

is  via  the  iterated  3  by  3  me;m  filter.  This  filter  is  based  on  a  3 

by  S  neighborltood,  and  can  cither  be  viewed  as  a  weighted  filter  on 

this  neighborhood  or  as  a  3  by  3  mean  filter  applied  twice.  (See  |lUj 

for  a  discussion  of  this  filter.).  Table  3  provides  a  comparison  of 

the  .allowing  5  segmentation  techniques:  (1)  original  data;  (2)  5/9 

rule:  (3)  3/9  rule  but  using  iterated  3  by  3  mean  for  4  or  5  members 

of  M  in  the  3  by  3  neighborhood;  (4)  iterated  3  by  3  mean;  (S) 

13/2S  rule.  Rv  Theorem  2,  the  13/25  rule  has  the  highest  probability 

of  correct  classification  for  interior  points,  but  as  evidenced  by 

Table  3,  other  segmentation  techniques  can  give  better  overall 

performance.  To  see  why  this  is  so,  one  might  notice  that  the  15/25 

treats  equal lv  the  following  two  data  sets: 

0  0  0  0  0  00100 

0  1  1  1  0  0  0  0  1  0 

0  1110  10  0  10 
0  1  1  l  0  0  0  1  1  1 

0  0  0  0  0  l  I  0  0  0 

since  they  each  have  exactly  9  entries  of  1.  Yet  the  first  data  set 
is  imich  more  likely  to  reflect  x  being  in  the  set  M.  On  the  other 
hand,  the  iterated  5  bv  3  mean  would  produce  values  of  O.bl  and  0.38 
for  these  sets,  thus  putting  x  in  M  for  the  first  but  not  the 
second  data  set. 


Table  3.  Percentage  incorrect  classification  based  on  10  trials.  Sec 
text  for  explanation  of  rules,  Error  U8  refers  to  a  uni fom  error 
distribution  taking  values  from  -8  to  *8.  Error  Cf>  refers  to  a  Gaussian 
error  distribution  with  expected  value  0  and  standard  deviation  5. 

The  other  error  entries  are  defined  similarly,  futa  set  A  is  the 
image  indicated  by  l's  in  Fig.  6(a)  and  B  is  its  complement,  data  C 
is  the  image  of  Fig.  6(b),  and  D  is  its  complement . 
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Fig.  5. 


Top  portion  is  original 
S/9  rule,  and  bottom  is 


image.  Next  portion  is  ’esult  of 
result  of  modified  5/9  rule. 
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S.  Some  monotone  equivariant  segmentation  techniques.  Many  commonly 
used  spatial  techniques  for  image  enhancement  lead  to  monotone 
equivariant  segmentation  algorithms.  To  illustrate  this,  consider  the 
histogram  modification  techniques  described  in  [3],  pp.  127-136.  If 
the  data  are  first  rank  ordered,  and  after  application  of  the  technique, 
the  output  is  labeled  by  the  original  data  values,  the  resulting 
technique  is  easily  seen  to  be  monotone  equivariant.  For  example,  if 
the  original  data  values  are  2.3,  5,  8.7,  12  and  20,  the  rank-ordering 
would  produce  ranks  of  1  through  5.  If  a  histogram  modification 
technique  produces  output  levels  of  3  and  5,  and  if  this  ouput  is  then 
labeled  as  8.7  and  20  (the  values  of  the  original  data  corresponding 
to  these  ranks),  then  the  resulting  technique  is  monotone  equivariant. 

We  described  in  (9]  a  segmentation  technique  that  is  also 
monotone  equivariant.  It  will  be  convenient  to  briefly  describe  it 
here.  The  input  data  is  an  m  by  n  array  A  of  nonnegativc 
integers.  The  program  consists  of  the  following  parts: 

A.  Prefiltering.  A  version  of  a  k  by  k  mean  or  median 
filter  is  applied  to  smooth  the  data,  and  the  ouput  is  rounded  to  the 
nearest  integer  to  form  a  matrix  B. 

B.  Thinout.  A  frequency  count  is  made  of  the  values  appearing 
in  B.  Those  values  that  occur  with  frequency  less  than  some 
threshhold  are  deleted  and  the  points  corresponding  to  them  reassigned 
to  the  closest  valid  remaining  data  value.  Alternately,  the  k 
highest  occurring  values  can  be  retained.  The  resulting  matrix  is 
denoted  C. 


C.  Suppose  matrix  C  has  data  values  ,  j 7. , , , . The  3 

by  3  dispersion  of  value  jj  is  defined  as  follows:  lor  each  point 
in  C  having  value  jj,  look  at  a  3  by  3  neighborhood  centered  on 
that  point,  and  calculate  the  number  of  points  in  that  neighborhood 
that  do  not  have  value  jj.  tbmpute  the  average  over  all  |x>ints 
having  value  for  which  3  by  3  neighborhoods  can  be  found.  Ibis 
is  the  dispersion  for  i^.  Continue  the  process  for  j 7,j . . . 

Lb  Various  options  exist  for  deleting  1  or  more  of  the  data 
values  having  the  highest  level  dispersion.  The  simplest  is  to  iust 
delete  the  highest  level  value.  Other  options  might  include  delving 
all  values  whose  dispersion  exceeds  0.9  on  the  first  pass,  and  then 
dropping  this  cutoff  down  by  increments  of  0.1  until  a  stopping 
criterion  is  reached.  Various  options  also  exist  for  the  reassignment 
of  points  whose  value  has  been  deleted.  They  proceed  on  both  a  global 
and  local  basis.  Cluster  means  can  be  computed  for  cadi  valid  cluster, 
and  ixiints  assigned  either  to  the  nearest  mean,  or  by  meaas  of  a  Bayes 
decision  rule  distance.  Alternately,  this  car  be  done  on  a  global 
basis,  and  all  points  having  a  given  deleted  value  can  he  assigned  to 
the  nearest  valid  cluster.  These  techniques  are  called  ANTAR  and 
ANIARU.  A  second  type  of  tc’chnique  involves  assignment  of  points 
according  to  whether  their  labels  are  above  or  below  the  averages  of 
the  next  valid  clusters  that  arc  above  or  below  them.  This  can  be 
done  on  either  a  local  or  global  basis,  and  the  resulting  techniques 


are  ANLiXT  and  AMH.XTU.  These  techniques  as  they  have  been  described 


p 


arc  not  monotone  cquivariant .  It',  however,  the  input  data  are  first 
rank  ordered,  and  the  output  is  labelled  according  to  which  input 
value  corresponds  to  which  rank,  then  the  resulting  techniques  do 
become  monotone  cquivariant.  An  illustration  of  the  operation  of  the 
algoritlun  occurs  in  Table  4.  The  input  date  consists  of  a  mixture  of 
1  normal  distributions,  one  with  expected  value  30  and  the  other  with 
expected  value  20,  each  having  a  standard  deviation  of  4.  The  data 
entries  are  rounded  to  the  nearest  integer,  and  a  3  by  3  mean  prefilic 
is  used.  This  prefilter  tries  to  remove  outliers  by  deleting  the 
highest  and  lowest  entries  from  each  neighborhood,  and  outputting  the 
average  of  the  remaining  7  members.  The  "nondi rected  dispersion" 
shown  in  this  table  is  identical  to  the  version  of  dispersion  we 
described  earlier.  The  "directed  dispersion"  refers  to  the  average 
of  the  maximum  number  of  points  in  the  subregions  to  the  North, 

South,  Hast  and  West  of  the  center  point  that  lie  in  regions  other 
than  that  of  the  center  point.  The  idea  here  is  that  the  directed 
dispersion  would  distinguish  between  boundary  points  to  a  region  and 
noise.  Notice  the  dramatic  drop  in  the  values  of  the  dispersion  when 
the  proper  number  of  regions  is  found.  The  segmentation  algorithm 
was  ANEAR,  and  the  input  data  was  arranged  so  that  one  population  was 
in  the  upper  half  of  the  input  matrix,  and  the  other  in  the  lower 


half. 


PERCENTAGE 
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7.  Construction  of  a  segmentation  algorithm.  A  program  based  on  th 
earlier  material  will  now  be  described  and  illustrated.  'Ihe  input 
data  is  as  in  Section  3.  The  program  itself  has  two  phases: 

Phase  1.  Find  levels  at  which  to  slice  the  data. 

Phase  2.  Make  appropriate  slices  and  use  a  i/h  rule  to  increase 
the  probability  of  correct  classi f ication. 

As  was  noted  in  section  4,  the  Phase  2  portion  of  the  algor ithm  is  a 
flat  segmentation  technique.  The  program  can  be  used  as  a  cleaning 
algorith,  or  it  is  suited  for  the  determination  of  the  principal 
regions  of  a  digital  picture. 

Description  of  Phase  1.  6  methods  of  determining  the  slice 

levels  are  built  into  the  program. 

Method  1.  The  mean  and  standard  deviation  of  the  input  data  are 
determined.  The  slices  are  taken  at  M-2S,  M~S,  M,  M*S,  and  M+2S, 
where  M  is  the  mean  and  S  the  standard  deviation.  If  this  get’s 
one  outside  the  data  range,  then  the  extreme  values  are  modified  so 
that  they  lie  between  the  minimum  and  maximum  values  of  the  input. 

Method.  2.  A  frequency  count  is  taken  of  the  levels  that  appear 
in  the  input  data,  and  slices  are  taken  at  relative  maximum  points  of 
tli is  distribution. 

Method.  3.  This  uses  relative  minima  of  the  dispersion. 

Method  4.  This  is  the  same  as  method  3,  except  that  if  A 
represents  the  vector  of  distinct  data  values,  then  for  A|i|,  one 
is  interested  in  the  average  number  of  points  that  do  not  lie  in 
A{ i - 1 ] ,  A[i)  or  A[i+1].  One  then  takes  the  relative  minimum  points. 


Method  5.  This  too  is  similar  to  Method  3,  except  that  the 
output  is  the  average  variance  in  t  by  t  neighborhoods  centered 
on  points  having  a  specified  value.  The  slice  levels  again  are  the 
relative  minima. 

Method  6.  User  specifies  slice  levels. 

B.  Description  of  Phase  2.  Having  arrived  at  a  list  of  slice 
levels,  one  now  chooses  a  j/k ^  rule.  Hie  actual  slices  are  constructed 
so  that  they  are  halfway  between  the  slice  input  levels,  and  the 
resulting  slices  are  given  the  labels  of  the  slice  inputs.  Thus 
if  one  wanted  slices  at  17,  20,  22,  26,  and  30,  one  would  actually 
look  at  the  increasing  sequence  of  sets  Mj  c  M.,  <_  M,  c  M^, 
where  \h  =  fx:  <  k^}  with  =  18.5,  k2  =  21 ,  k_  =  24,  k^  -  28, 

and  kj.  =  the  maximum  value  of  X.  Ihis  forms  5  clusters,  and  they 
are  assigned  the  values  17,  20,  22,  26  and  30.  Alternately,  they 

could  be  labeled  by  their  means. 

The  actual  implementation  of  this  process  is  very  simple.  For 
input  data  X,  one  looks  at  the  lowest  actual  slice  level  kj .  A 
Boolean  matrix  is  formed  by  letting  1  denote  points  whose  value 

a 

is  <  k^  and  0  elsewhere.  If  a  j/kc  rule  is  used,  one  then  looks 
at  k  by  k  regions.  If  the  number  of  1 's  in  such  a  region  is 
j,  the  output  is  1;  otherwise,  it  is  0.  The  output  for  k^  is 
added  to  this,  and  the  process  continues  until  the  supply  of  actual 
slice  levels  is  exhausted,  (imputation  time  may  be  reduced  by 
observing  that  if  at  a  given  stage  a  1  is  produced,  then  all 


succeeding  stages  must  also  produce  a  1 ,  so  there  js  no  reason  to 
consider  neighborhoods  involving  that  point.  This  of  course  is 
simply  a  reflection  of  the  fact  that  a  j/k"  rule  represents  an 
isotone  mapping  on  P(X).  The  actual  implement at ion  can  be  further 
optimized  by  first  applying,  a  k  by  !  'ian  filter,  and  applying 
the  Phase  1  techniques  to  the  output  of  this  *  i  I  ter. 

We  close  by  considering  some  examples  involving  real  data.  The 
data  are  from  two  sources:  the  KestinghouscH.IK  tape  and  an  infrared 
weather  tape  that  was  supplied  by  the  Air  Force  Geophysical  Laboratory 
at  Hanscom  AFB.  Plates  1-5  illustrate  the  5  methods  of  selecting 
slice  levels  that  here  explained  earlier  in  this  section,  and  Plate  <> 
shows  the  output  of  the  Sl.GMFNT  program  on  the  same  data  set.  lhough 
there  are  some  minor  differences  shown  between  the  various  i/k“ 
rules  used,  all  of  the  methods  did  a  good  job  of  showing  the  central 
object  of  interest  -  a  tank.  One  should  hear  in  mind  that  the  shades 
of  grey  in  the  pictures  serve  only  to  distinguish  regions.  They  do 
not  necessarily  represent  actual  temperature  levels  of  the  regions. 

It  is  also  of  interest  to  note  the  difference  in  resolution  between 
the  13/25  rule  and  the  other  rules  that  are  used.  This  is  especially 
apparent  in  Plates  14  and  1“. 
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Plato  1.  Port  ion  of  Record  J I  of  We*st  inghouse  !  MR  lajK*.  Slice*  program 
out|Hit  using  Method  1.  ilpp«-r  pictures  represent  output  using 
iterated  3  !>v  3  tne*an  filter  and  3/!>  rule-.  Hottena  i  icturcs 
represent  S/P  rule  and  I  3/ 2 f>  rule. 


Plate  2.  Same  as  Plate*  1,  except  that  slice  levels  arc  e'ht  iinex!  I*y  Method 
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Plate  11.  Same  us  Plate  t>,  except  that  data  is  iioin  Record  b8. 


Plate  12. 


Portion  of  Record  12  of  H.IR  tape.  Slice  program  output  using 
Method  S.  format  follow.  '!nt  of  Plate  l. 


